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ABSTBACT 

This paper describes an effort to implement a 
cost-ef f activenass program using systems analysis in an elementary 
school district, the Rio Linda Union School District in California* 
The systems design cycle employed has three phases, policy-making 
evaluation, and action-implementation. During the first phase, the 
general philosophy or mission of the organization is described, the 
goals and objectives are established, tlieir priorities are ordered, 
and the alternative programs to meet those goals and objectives are 
generated. During the second phase, the relative worth of the various 
alternatives is determined, and the objectives* attributes and their 
measures of effectiveness are established. During the third phase, 
the programs to be implemented are chosen from among the 
alternatives, put into effect ^ evaluated, and the results fed back 
into the next planning cycle* Problems in communication with teachers 
and coordinators and in overcoming raaentment of the approach are 
discussed. One of the major successes of these efforts to implement 
cost--eff ectivenesa and program budgeting in this school district is 
that the goals and objectives of the education process are defined 
clearly at all levels. Systematic planning and evaluation of costs 
and effectiveness also brings about greater dialog among the parties 
involved and more concern for planning program alternatives. (KM) 
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INTRODUCTION 

Thle paper describes an effort to implement a cos t^ef fact iveness 
progratfl using systems analysis in an elementary school district, Rio 
Linda Union School District in California requested the authors' 
asolitance after the California State Soard of Education mandated that 
each school district plan and budget by the Fall of 1973 according to a 
Pro0ram Planning and BudpetinR System (PPBS) . Ho^Jeverj the mandate has 
not been enforced for reasons ^yhich yill be discussed later. 

The superintendent and his staff at Rio Linda had eKplored prDgrara 
budgeting to the point x^here they T?ere ready to involve all the district 
admlnlstratorQ and supervisors* They were also opening a school 
constructed and operated with new concepts and wanted some way to measure 
Its effectiveness. The paper describes the systems design cycle employed 
and Includes the first goals and objectivei which were developed as well 
as the ;nodels for evaluating alternative proiirams. It also describes the 
problems encountered and successes claimed* 

THE SYSTEtiS DESICa? CTCLE 

The Overall Process 

The District administratlvt and suparvlsory staff and the consultants 
(authors) discussed the framework for cost effectiveness planning and 
evaluation of the system design cycle which is shown in Figure 1* It, 
illustrates the three phases of the cycle* (1) Pollcy-"tnakingj 
(2) Evaluatloni (3) Action-implementation. 
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During the first phase the 3er4eral philososhy or ffllsslon of the 
organisation Is described^ tha ^oali and objectlvea are established, 
their priorities are ordered and the alternative programs to meat those 
goals and objectives are generated* During the second phase the relative 
worth of the various alternatives Is determined and the objectives - 
attributes and their measures of effectiveness are eitabllshed* During 
the third phases the programs to be Implemented are chosen from among the 
alternatives s put into effects evaluated and the reiults fed back Into 
the neKt plaming cycle* 

The Goal and Objective Setting Process 

The School Board may state a desire^ a staff man may do the work but 
the superintendent must take the lead and obtain agreemant on the general 
ralaslon and broad goals from all the groups In the system I teachers 5 
admlnistratgrs, boards parents^ taKpayers and government. The teachers 
and administrators must then a^^ee on the more specific objectives with 
the approval of the board. liany studies have verified that an organlza-- 
tion of professional people fienerally functions more effectively If Its 
members have a voice In setting the goals and objectlveii In addltionj 
the goals of the Individuals and of the eub-units become better integrated 
with those of the whole organisation t The goals are more realistic and 
the Individxials are more coimltted to achieving then* 

Figure 2 lllustratei the goal-setting process. The superintendent 
dotermines the broad goals of his district with the approval of the board 
takiiig into account CDnstraints InpDsed by the parentis other schools. 



■FIGU":i 2 
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the govarnmant, the voters and taxpayGrsj professional associations and 

labor unions, students and technology available * To the extent the 

citizens in the conimimity are interested, they should bo involved in the 

goal-setting process * In some distrlGts like lilllsborough, California, 

3 

the citizens are very active* In other districts^ it is difficult to 
Involye th etn. 

The superintendent coranunlcates the broad goals through the 
principals to the teachers* Then the teacherf indlylriually and oolleetlvsly 
propose r;lassrooTO goals while the principal proposes school goals. The 
two are modified and integrated into a set of comon ichool goals. Then 
the principals, individually md Gollectivelys propose these goals to the 
superliitendent tgfeo astabliihes district goals whlchj in turn, become the 
district program for the period* 

The hierarchy of goals and objeetlvee initially propceed at Rio 
Linda were as shorn in Figure 3. The statement of philosophy or missiori, 
often considered as bread as '^God'' and ''Hotherhood*% must be carefully 
defined because it points the system -s diraction and boundaries. For 
eicamplBj the officers of one of the natlon-s largest railroads for years 
thou^t of themselves as In the railroad business^with some reason* Then 
one day they realised they had soiae trucks and pipelines and redefined 
their mission as being in the transportation business. As a results more 
effort and resources tTere put into other profitable .modes of transportation 
besidds the railroad* 

The B^als to implement the Rio Linda lEssion were a composite of its 
goals, those of other SGhool districts and the California School Boards 
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Association.^ The layman and the professional would probably agree that 
these goals ara^ for the moat part^ in their proper order of rank t^ith 
the most diffloult to measure being at the bottom of ^e list. HoT^ever^ 
to rank them according to the Systeins Design Hodel, cost , effectiveness of 
alternative prngranis would have to be developed first* In any budget 

m 

cycle, money always runs out before programs to accomplish goals at the 
bottom of the list are funded • However, in the next cycle the changing 
environment raay demand a re-ranking; * In additions ione progr«TOe are 
directed toward more than one goal. For example^ a physical education 
program may be dlrBcted not only towards the phyilcal health goals but 
also towards the mental health and Interactive ildJla goals. 

"Program Generr.tlon and Analye ie^ 

To help accomplish the general goals of developing coifflaunlcatlon 
skills and an understanding of the rights ^ obligationi and moral values 
of a citizen in a democracys a program in Spanish might be suggested. 
The sub-goals are teaching children to reads write^ and speak Spanish 
and to understand the Spanish speaking countrlei^ culture cospared to ours* 
What alternative programs can be employed to meet these Bub-goala? At 
this point the appropriate teachers and aupervlsors can brainstorm the 
alternatlvee mi note the resourcei required. They might employ the 
model shoxm in Figure 4* To determine what each program coats ^ they 
might use the model shorn in Figure 5. . 

*Thii particular program is a hypothetical one which was not generate at 
Rio Linda but was used by the consultants to demonstrate to their clients 
the us© of the model for program analysis. 



FIGURE 4 
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PIGURE 5 

- RESOURCES MP INPUTS - COSTS FOR EACH PROGRAM ALTEPJfJAriVE 



Inputs - Resources 

P ersonnel 

Teachtrs Salaiflee 
Fixad Charges 



Allocation, percent of 
one Principal 

Allocation, pereent of 
one Coordinator 



Prof^ram 1 
$ 



Specialists Salary & P.C* $_ 



Inputs CoBta 
FroRram 2 Program 3 



Program 4 



Suppliag and Materials 
Texts 

Records & Tape Recorders 
Language Lab Equipment 
Mlscell&neous Supplies 



TranspGrtatlon 

Bus for six visits to 
Cultural Center 



Organi^gd Visits 

Contract for visits 
related to foreign 
culture 



TOTALS 



Coiti all allocations can be further refined by specifying budget 
classif icattonSp etc. 



F va lukz tort P lannin ^ P go ce a s 

With the above data, the planners have the 'coet'^ half of the coct- 
effeciivenesa fraction, iniat about the '^effectiveness-' half? The 
evaluation phase of the Systems Design Cycle seeks to translate the gqalf^ 
into specific objeetives which cm be eifaluated, Objectivea are e:TOrecBed 
in /measurftbla attributes* Mi attribute la a factor or variable by whtcl, 
specific objectives can bit identified* An attribute and its measure of 
ef f ectivenesa determine the objective* For e^^mples to obtain thi eub-^Eoal^: 
o£ learning the Spaniah lattp^ua^a and culture ^fs tnlght aet out the f ollorinr' 
objectives I 

OBJECTIVSS^ 

ectiva Att Tibuta Measure of Ef fcctlveneis 

1 Raadlng Ability A native speakar should be abls to und^totand 

a slKth grade pupil reading a 200-^70 rd aiuj.clei 
in the Itoguage in questioni 

2 TJriting Ability A slscth grade pupil should be able to wite 

short sentences in the language and rate a C 
grade ^rhen compared to an average class. 

3 Speaking Ability A slKth grade pupil should be able to eicp^ess 

short sentances in the language without help 
of a reading teEt and be undaMtood by a 
native sp taker, 

h Coimtln^ Ability A sixth grade pupil should be able to count 

numerals up to 1000 in the forslgn languapa 
; fflthout hesitiiney* 

5 ItaoTfiedga of A sixth grade student should be able to 

Culture deicribe the culture of one country related 

to the foreign language in questioni Culture 
will be defined as cue tomss history , and 
other aignificmt traits* 
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6 



Understanding 
Relatlonehlps 



aiowledge of m foreign language is useless 
unless the student understands how his country 
relatei to other countries where the language 
is spoken. The student will be tasted on 
his knowledge of customs and geographical 
facta which day influence the IJ,S. and vicQ 
versa* 



Wilch program most effectively meeti the objeetlves? In Figure 6 
the planners intuitively weigh the objectives in terms of what thay think 
they want to accompllih and distribute the weighti among the four prdgrams* 
It turns out that pragram IfU Is both the least costly and the most 
effectlvei However, on further, investigation the planners learn there 
are Insufficient community resourQes to make internehlps faasible. 
Thereforag they look at ptoff^mu H md #3, Program #2 la cheaper but #3 
is more effective and for 9IO5OOO morei the plannera opt for program #3. 

I mplementation and Evaluation 

The analysis and evaluation of posilble Spanish programs Is completed, 
Now the staff must compare the Foreign Language Program versus others 
ECGompllihlng a variety of goale. In terms of cost and i^ff ectlvenesi * 
planners may well find that Spanish comfAunieatlon skill and undiretandlno 
will rank of Isis Importancs than other competing pro grams. 

Educational programs cannot be evaluated solely on the basis of ^■hard" 
evidence such as can be done to measure the strength of a steel column 
in mechanlci or the profitability of a cast reduction on sales programi 
in private industry* Evaluation of the results of education must still 
allw far iubj active assess^^ of the effects 

of programs on pupils* In addition 1 the degree of Importance and/or 
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rmklng ainong prograra is lubjeet to the political neceisities of the 
aituatlon at any particular moment In time. 

tJhen all the coet'-ef fectlvaneie evaluations and junglinge are 
eomplBtad within the constralnte of the available resourcess the accountant 
can total his program budgets into his total district budget, notify the 
program admlnl.^trators and set up cpntrols to watch the flow of eKpendl'- 
tures against the programs. Figure 7 suramariges the cycle. 

At the end of the established time period^ the attrlbute§ must be 
measured then determined whether or not the objectives have been met andp 
if nots ^?hy not? T'ihatevar la learned from the e'valuatlon will be used 
aa Inputs into planning the next cycle of goals and objectives* 

\mE PRODLEMS ENCOUHTERED AND SUCCESSES CLADffiD 

Problems ' 

The inplementation of PPBS in all of California school districts 
has been halted by a leslilative reaolution pending further haarlnfis and 
investigation,^^ This event is most dlscDura^lng in the light of the 
great deal of tlnte dnd effort which Rio Linda and other districts have 
devoted to meeting the original PPBS implementation deadline* The stay 
wae justified for varloue reasonsi one ^roup supporting it feared that 
PPBS was a '^comuniit plot "! ^ ^ 

Implementation of a program such ao a prograin plmnlng and budgeting 
system is haTQpered by the amount of time that the people at all levels— 
from teaeherg to the board and eyen tha eofbmunity--ttust devote to its 
inception. Those in authority must request that time be allocated to it. 



FIGURE 7 

FINAL INTEGRATIOIl OF PROGRAMS BUDGETS TOWARD PROGMM BUDGETING^ 
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Othert^ise, the planning job breaks down for laek of cominunlcatlons arnQng 

all levels of the fyatem* 

Initially, the authors had dlffieulty conciunl eating with tar^chers 

and CQordlnatora although no coifflnunleatlon barrier was detected between 

them and the top level administrative and business itaff. Teachers and 

coordinators did not understand the words we used (edueatora and business 

men have their own Jargon), and at firsts they did not follow the logie 

of the goals, objectives and programs' hierarchy. They worried about 

eKact definitions until we eKplalned It really did not matter If they 

called "sQaia' ^''objectives" or vice versa , 

Matty teachers thought in terms of tlie classroom reading program and 

■ 

art program as being "good'* In themselves without tying then back to the 
goals and toisslon of the eduei tJ,on system* Some resented attaching 
dollar signs to such -'good" thingo as ''creative appreciation"* and 
"sensitivity*- * Others felt the whole program was balng "stuffed down 
their throats by administration." It took awhile before we could talk 
the same language and get to the point where we could begin to set 
objectives* 

Successe s 

Regardless of how varloue factions and groups may feel about the 
Impact of program budgeting^ one thing is certaini It brings the goals 
and objectives of all the agents Involved In the education process into 
foeu8--**the public, the pupils p the legislators, government officials, 
administrators s teachers I non-^teachers I M 



The Rio Llr4cla Union School Distf?,ct in emphatia in poiuting out th|L^ 
one of the major beniflts of efforts to Impiemant eoat-nffactlvtness and 
program budgeting is that the goals and objeetives of the edueatioii 
process are defined clearly at all levels. The District has had to 
formulate goals and objeetives which reflects 

(1) the desires of the coTOunityg l.e, parents and public? 

(2) the dictates of the California State Board of Education and 
..of the legiflaturej and 

(3) the opinions of the teaQhers. 

Also* it is apparent from the District's Annual Report that thft admlnls*- 
tratlon sets targets from year to year and sieasures the extent of its 
achievamenti a procedure wHbh had not been formalized previously and 
vhirfi provides Valuable information for future planning. 

Before the implementation of PPBS, the teachers ran many pro.^raL.v 
for which they %7ere hard pressed to find clear purposes. This became 
obvious during the early discussiens on the subject even on Important 
programs such as readlnf?, physical education and mthematics* Host 
teachers were eager to jet involved in the declslon-makln^^ process and 
RKpreseed great satisfaction in clarifying the purposes of their progrmcis 
and participating in malclng school policy, Teacheri' Involvement in 
^urrlculuTn planning increased considerably, 

T^hether goals are used as Inputs for PPBS or not, the process by 
which they evolve has been thorouphly bimeficlal. Through tncreiscd 
parti cipationi the eoraminitys parents and teachers have gained influence 
iind power, , - 



The role of the teacher hai benefited fromi 



(1) Increased opportunity and interest in getting Involved In the 
planning and designing of objectives and profjramaf 

(2) Improved concensus in what they are trying to achieve; and 

(3) increased teacher participation in Certificated EducatiQn 
Councils and other professional aisoclations euch as the 
California Taachars' Aisdciation* 

The role of the teacher has been influenced by^ 

(1) pressure from the public at large to obtain improved coat 
eff ectlvaneas of ed,ucatlon, and 

(2) legislative mandate to measure not only teacher competence 
but teacher ef fectlveneis (more about this later)* 

As a result of a more systematic forpulatlon of ^oals and objectivee 
at all levels where PPBS has been initiated ^ 

(1) Programs are better designed. 

(2) Teachers have become more ''poals^* and - profjr^e*' oriented* 

(3) A more systematic procedure for program development is being 
f ollmrtd » 

(4) tJhen new progrms arecreatedj a '^project management' type of 
organization has evolved which superlinpoies horizontal organiza-^ 
tlon forms which cut across the traditional vertical hi erarchal 
structure* 



(5) To a certain eKtents teachers have gained increased deciaion- 
maklng power in deslf^nlng curriculum changes and programs i 

(6) A greater regard has evolved for considering and selecting 
program alternatives with the best payoff* 

Improved progr am evaluation has also occurred as the result of other 
requirements such as those imposed by the Stull Blll.^^ Tills bill directs 



district boards to develop evaluation and asiesement guldallnes and 
procedures trhich must Include the folloTfln,^ elenents (apparently, thli 
evaluation is not ''communist*' inspired) I 

(1) Teacher Coin petence - ''Assessment of certificated personnel as 
it relates to .the established standards' and Assessment of 
other duties normally required. . sas an adjunct to* » .regular 
assignments, ^^'l-l 

(2) Student Progress ^ ''The establishment of standards of expected 
student progress Iti each area of study and of techniques for 
the assessments of that progress. 

(3) S tudent Control -^*The astablishment of procedures and teehniqui 
for ascertaining that the certificated employee is inalntalning 
proper control and is preserving a suitable learnino environ^ 
ment*''ll 

The accomplishment of the intent of the Stull Bill has required 
that teachers and administrators set objectives and measures of their 
achievement J similar to those that are demanded by PPBS. Standards of 
pupil progress and growth expectations are being established for most 
skill areas* 

C0NCLU8I0HS 

The whole educational process is underf^olnfi important chanpesj not 
the least of vhlch is the preoccupation of those footing the bill with 
'■getting their money's worth. These efforts have sparked renewed 
interest in methodologies such as the Systems Approach or Systems 
Analysis s PPBS and others which promise systematic planning and evalua^ 
tion of costs and effectlvenass. An investi<iation in the results obtalne 
to date point to the following gains r 



(1) Thera is a sreater dialogue among all parties Involved in 
education ragardlng what should be dor.a. Incre^^sed dlalogua 
should lead eventually to higher coniensus and niotlvation* 

(2) There ii more coneern for planniug pr^ram alternatives which 
meet the objectives In order to allocate resources to those 
which best satisfy the needs o£ the recipients. 

(3) In the end ^ the pupils, and through them, the public^ should 
be the direct beneficiaries of better programs^ better schools^ 
and better education* ^ 
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